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Hyperspectral  Imaging  (HSI) 


Sample  HSI  Data  Cube 


High  dimensionality  data 

-  High  spatial  resolution  EO  imagery 

-  Hundreds  of  co-registered,  contiguous, 
narrow  spectral  channels  (X/AX^  100) 

-  0.4  to  2.5  |xm  systems  exist,  3  to  12  |im 
emerging 


Diverse  applications 

-  Atmospheric  characterization 

-  Terrain  delimitation 

-  Target  detection 

-  Material  identification 

-  Spatially  unresolved  object  detection 


100 


Example  HSI  Measurements 

T - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 — 

Surface  Sensing 

11  I  Atmospheric  Sensing 

Opaque 
Tree  Canopy 


I  ^1 _ I _ L_ 


0.4  0.7  1.0  1.3  1.6  1.9  2.2  2.5 

Waveiength  (|xm) 
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Motivation 


*  Combined  sensing  of  HSi  with  others  offers  potentiai  for 
greater  payoff 

*  Examples: 

-  HSIandSAR 

Complementary  roles  result  in  surface  penetration,  false  alarm 
reduction  and  target  identification  enhancement 

-  HSI  and  Panchromatic  Imagery 

Enhanced  spatial  and  spectral  information  for  improved 
background  delimitation  and  better  target 
characterization/identification 
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Outline 


•  Overview 

-  Objectives 

-  Fusion  applications 

•  Fusion  exampies 

-  SAR/HSI 

Explore  different  phenomenologies 

-  HSI/HPI 

Utilize  superior  respective  spectral  and  spatial  resolutions 

•  Summary 


HSI:  Hyperspectral  Imaging 

SAR:  Synthetic  Aperture  Radar 

HPI:  High-resolution  Panchromatic  Imaging 
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HSI/SAR  Fusion  Example: 

Dixie-97  Data  Coiiection,  28  May  1997 


HYDICE  HSI 


P-3  UWB  SAR  Image 


■n*, 


Site  Sketch 


\\ 


7/" 


1 


Vehicle 

□',  i  under  net 

ST^ehicle 
partially 
exposed 


I. 


Vehicler-^^ 

obscured 


HYDICE  P-3 

0.4  <  A,  <  2.5  |im  200  -  700  MHz 


Viewing 

geometry 

Nadir  viewing 

Depression 
angle  ~  30° 

GSD 

0.76m  X  1.1m 

0.23m  X  0.4m 
(resampled) 

Forest,  roads,  open  area 
backgrounds 

Fabric  nets,  exposed  and 
concealed  vehicles 

Overlapping  coverage  for 
HSI  and  SAR  fusion 
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SAR/HSI  Detection  Comparison  and 
Sampie  iD  Fusion  Approach 


Trees 

Grass 

Roads 

Camo 

Nets 

Vehicles 

UHF 

SAR 

FA 

Low 

Signal 

Low 

Signal 

No  Det 

Det 

HSI 

ID 

ID 

ID 

Det  in 
open 

Det  in 
open 

FA  =  False  Alarm 
ID  =  Identification 
Det  =  Detection 


SAR  Detection 


Vehicles,  Trees,  etc. 


HSI  Feature  Analysis 

T 

Terrain  Charact.  (Roads,  trees,  open  areas) 
Camo  Nets 


Co-registration 


Map  Terrain  Features  - ►  Reduce  SAR  FA 

i 

Superimpose  Camo  Nets - vehicles  under  nets 

on  SAR  detection 

i 

Other  SAR  Detections - ►  Material  ID 
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HSI  Analysis  Results 


HSI 


Sample  Spectra 


0.5  1.0  1.5  2.0  2.5 

Wavelength  (^m) 


Net  detection 


Background  characterization 
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Fusion  of  SAR/HSI  Detections 


P-3  UHF  SAR 
6  dBsm  Thresholded 


HYDICE  HSI 


Open  area/Fabric  net 
Detection 


Combined  SAR/HSI  Data 
Vehicle  under  Net 
Identified 


SAR  detection 
confirmed  and 
material  identified 
using  HSI 


SAR/HSI  Fusion  Summary 


*  Common  data  set  identified 

-  Dixie-97  with  forest  background 

-  Fabric  nets,  vehicles,  vehicle  under  fabric  net 

*  HSI  data  detected  fabric  nets  not  seen  by  SAR 

-  Terrain  characterization  also  established 

*  SAR/HSI  image  co-registration  accomplished 

*  Fusion  of  SAR/HSI  data  results  in: 

-  Detection  of  vehicle  under  net 

-  Reduction  of  SAR  false  alarms 

-  Confirmation  of  SAR  detection  and  material  identification 
Complementary  roles  between  HSI  and  SAR  illustrated 
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Outline 


•  Overview 

-  Objectives 

-  Fusion  applications 

•  Fusion  examples 

-  SAR/HSI 

-  HSI/HPI 

Enhanced  spatial-spectral  analysis 

•  Summary 


HSI:  Hyperspectral  Imaging 

SAR:  Synthetic  Aperture  Radar 

HPI:  High-resolution  Panchromatic  Imaging 
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Motivation  for  Fusion  of  HSi  and 
Panchromatic  imagery 


*  HSI  and  high  resolution  EO  sensors  often  co-exist  in 
measurement  platforms  (Space,  A/C,  and  UAV) 

*  Spatial  resolution  for  Pan  typicaliy  3-8  times  better  than  HSI 


Example  Space  Platforms 


Satellite 

EO-1 

(NASA) 

Warfighter-1 
(Air  Force) 

NEMO 

(Navy) 

HSI  Spectral 

0.4  -  2.5  [Lvn 

220  bands 

0.4  -  2.5  ixm 

200  bands 

0.4  -  2.5  |xm 

210  bands 

Scene  Size 

7.5  km  X  100  km 

5  km  X  20  km 

30  km  X  200  km 

HSI  IFOV 

30  m 

8  m 

30  m 

Co-incident  Pan 
(Visible  band) 

10  m 

1  m 

5  m 
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Fusion  of  Hyperspectral  and  High 
Resoiution  Panchromatic  Images 


Hyperspectral  Image  Cube 
8  m  resolution 


Reconstructed  HSI 
0.8  m  resolution 


+ 


Panchromatic  Image 
0.8  m  resolution 


(HSI) 


(HPI) 


Combined  spatial  and  spectral  information  from  high 
resoiution  data  for  enhanced  background  characterization 
and  target  detection  /  identification 
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Spatial  and  Spectral  Analysis  Approach 
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Anomaly  detection 
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Background  Classification  and  Anomaly 

Detection  on  HSI 


RGB 


Background 

classification 


Anomaly  detection 


□  Road 

□  Ground 

□  Vege. 

□  Dk.Vege. 
■  Shade 


Background 
map  from 
unsupervised 
classification 

Anomaiy 
detection  aiso 
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Spatial  Processing  on  HPI 


Panchromatic 
image  with  edges 


Sobel  operator: 
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RGB  Image 


Target  Identification: 

Fusion  of  HSI  and  Panchromatic  Imagery 


HSI:  Pan: 

Material  ID  Spatial  Edges 
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RGB  Image 


Target  Identification: 

Fusion  of  HSI  and  Panchromatic  Imagery 


HSI: 

Material  ID 


Pan: 

Spatial  Edges 


Combined  Result 


■  Paint  1 
□  Paint  2 
■ "Edges 

I W  Large  (4x8  m^) 
I  I  Small  (3x6  m^) 
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Target  Identification: 

Fusion  of  HSI  and  Panchromatic  Imagery 


HSi:  Pan: 

RGB  image  Materiai  iD  Spatiai  Edges 


Combined  Result 


■  Paint  1 
□  Paint  2 
■ "Edges 

I W  Large  (4x8  m^) 

I  I  Smaii  (3x6  m^) 

*  Target  material 
identified 

-  Spectral  matched 
filtering 
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Target  Identification: 

Fusion  of  HSI  and  Panchromatic  Imagery 


HSi: 

RGB  image  Materiai  iD 


Pan: 

Spatiai  Edges 


Combined  Result 


■  Paint  1 
□  Paint  2 
■ "Edges 

I W  Large  (4x8  m^) 
I  I  Smaii  (3x6  m^) 


*  Target  material 
identified 

-  Spectral  matched 
filtering 

*  Target  size,  shape 
ancTorientation 
determined 

-  Spatial  filtering  of 
edges  from  Pan 
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HSI/HPI  Fusion  Summary 


Table  of  Contents 


*  Simulated  data  generated 

-  Measured  data  from  high  resolution  HSI  as  “truth” 

-  HPI  data  by  band  integration 

-  HSI  data  by  spatial  degradation 

*  Methodology  developed  for  combined  spatial/spectral 
analysis 

*  Fusion  of  HSI/HPI  data  results  in: 

-  Enhanced  background  classification 

-  Better  target  characterization  and  identification 


Product  enhancement  illustrated  by  HSI/HPI  fusion 
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